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Abstract. A case study is presented for using models in eddy current NDE design for crack detection in 
Shuttle Reaction Control System thruster components. Numerical methods were used to address the 
complex geometry of the part and perform parametric studies of potential transducer designs. 
Simulations were found to show agreement with experimental results. Accurate representation of the 
coherent noise associated with the measurement and part geometry was found to be critical to properly 
evaluate the best probe designs. 
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INTRODUCTION 

During the life of the shuttle program, cracking in the relief radius of the primary 
reaction control system thruster has been identified [1]. This problem is shown in Figure 
1(a) where intergranular cracking extending from the relief radius propagates toward the 
acoustic cavity. Eddy current techniques have recently been developed to detect cracking 
in Shuttle Reaction Control System (RCS) thruster components [2-3]. An orthogonal dual 
coil probe shown in Figure 1(b) was developed to detect such cracks [2], In addition, 
remote field eddy current designs have been explored to find deeply buried flaws [3]. 
Recently, the orthogonal probe has been successfully validated for detecting larger cracks 
through a probability of detection study [4], 

Although an adequate design was developed and validated, there is an interest in better 
leveraging models to improve the design and validation of NDE techniques in the future. 
In general, modeling and simulation can produce significant benefits at several stages of 
the NDT technique development process [5]. First, models can be used to build a 
fundamental understanding of the inspection problem and aid in the interpretation of raw 
measurement data. Also, the design of eddy current probes can greatly benefit from 
parametric studies using accurate measurement models. During the validation process, 
model-assisted probability of detection (MAPOD) procedures have the potential to evaluate 
the reliability of an NDT technique at a lower cost with respect to conventional POD 
studies [5-6]. Some simulated studies for the RCS inspection were performed exploring 
changes in field strength with depth for different probe configurations [7]; however, more 
accurate measurement models are needed to better explore design and validation scenarios. 

A case study on the thruster inspection using eddy current NDE is presented for the use 
of models in the design and validation of NDE techniques. A primary objective of this 



paper is to develop a measurement model that closely represents the NDE inspection 
response. Two numerical methods, the finite element method and the volume integral 
method, are used to simulate the complex geometry of the part and results are compared 
with prior experimental work. Sensitivity studies are presented to determine the ideal 
probe orientations for varying crack lengths and explore the best NDE technique design. 
Lastly, the concept of a full model-assisted POD evaluation is discussed and applied for 
properly comparing different NDE technique designs. 




FIGURE 1. Diagram of (a) thruster cross-section with hole and relief radius and (b) orthogonal eddy current 
probe set [2], 

MODELING APPROACH 

Before selecting the appropriate modeling approach for this case study, all of the 
critical factors in the NDE measurement problem, including part geometry, part material 
properties, crack characteristics and NDE technique design, must be assessed in terms of 
their importance on the eddy current response. For the RCS thruster inspection, important 
factors concerning the eddy current probe design include the use of one or more coils 
(secondary coils as reference coils), coil orientations (three different axial directions with 
respect to the cavity), coil dimension, and probe frequency (1-50 kHz). Details of the 
inspection model are as follows. The thruster material is a niobium alloy with a 
conductivity of 13.2% IACS [8]. The intergranular cracks were modeled as open cracks. 
Crack orientation from the relief radius varies between 30° - 60°. Another critical point 
concerns the degree to which the geometry can be simplified and its role on simulation 
time. From a life prediction perspective, projected crack depth (remaining wall thickness 
for example 0.020" to 0.060") is more critical to measure than actual crack depth. All 
response plots are generated in terms of remaining material thickness. The frequency of all 
of the results in this study is 12 kHz. 

To accurately simulate an eddy current measurement for a variety of complex probe 
designs and test sample configurations, numerical methods, such as the finite difference 
method, finite element method (FEM), boundary integral equation method, the volume 
integral method, and meshless methods, have been developed [5]. Due to their ability to 
simulate complex problems efficiently in finite domains, the finite element method and 
volume integral method are used in this study. The numerical formulation of the finite 
element method solves the governing equations for each element using either Galerkin’s 
method or a variation approach [9], The resulting system of equations for the meshed 
domain is then solved most often in terms of magnetic vector potential. The measurement 



model for an eddy current coil can then be expressed in terms of changes in resistance and 
inductance, associated with dissipated power (P) in the region of the conductor and the 
stored energy (W) in the whole solution domain (f), respectively 
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Using the finite element solution for the electric and magnetic field intensities in the 
solution domain, the dissipated energy in the conductor (T) and stored energy in the whole 
solution domain (f) can be calculated as follows: 


P = JJ e E*dT' , (2) 

W = ^jHB*dT . (3) 


To evaluate the change in impedance in a conductor due solely to the presence of a crack or 
notch, the difference in impedance must be calculated from two separate problems 
representing 1) a pristine sample and 2) a sample containing a notch. Advantages of the 
FEM model include the fact that the solution is valid and available in the entire domain, 
and the ability to address problems with awkward geometries, inhomogeneous media and 
nonlinear materials. The primary disadvantage is simulation time for large problems. 

An alternative method to direct FEM solution concerns the use of an approximate 
representation of the thruster problem using the volume integral method. The volume 
integral equation or volume integral method models anomalous regions as a fictitious 
current source, which is directly related to departures in electrical conductivity and 
magnetic permeability from the host material. Green’s functions for infinitesimal current 
sources in multi-layered materials are applied and the method of moments (MoM) is used 
to solve the volume integral equation. The advantage of this formulation is that only the 
region of the scatterer needs to be discretized. Because of the regular grid, the resulting 
matrix has an advantageous structure where very large problems can be solved efficiently 
using the conjugate-gradient method. VIC-3D® is an implementation of the volume 
integral method where the geometry of a part can be built using a series of material layers 
(in Cartesian or cylindrical coordinates) with primitive geometries to model the ‘flaw’ or 
‘anomalous’ region across the multiple layers [10]. VIC-3D®, which is catered to eddy 
current simulation, also has the ability to quickly simulate numerous probe configurations 
of interest including varying orientation. 

The initial modeling approach for this problem was to use the finite element method 
and the volume integral method to separately address the complex geometry of the part and 
perform parametric studies of potential transducer designs, respectively. When using the 
finite element method, it is prudent to limit the domain of the mesh only to the portion of 
the part geometry that impacts the eddy current measurement. Figure 2(a) represents an 
initial level of simplification from the complete thruster geometry to minimize 
computational expense. Figures 2(b) and 2(c) show the model implementation in the 
Opera3D®, the electromagnetic FEM solver. An open notch at an angle of 45° was used to 
represent the crack in the model. Only a single coil with varying position in the acoustic 
cavity was simulated. For the volume integral method in VIC-3D®, additional 
approximations to the model were considered in order to improve simulation time. First, to 
study the effect of probe position, probe design (shape, orientation) and operating 
frequency, and varying crack length requiring numerous simulations, the thruster geometry 
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FIGURE 3. (a) Approximate model (1) of inspection problem in VIC-3D® for three different probe 
orientations: normal (norm), tangential (tangl) and tangential (tang2) and (b) approximate 2D representation 
of the thruster geometry profile (only side with relief radius displayed). 


was locally approximated to be an infinite flat plate as shown in Figure 3(a). Although 
VIC-3D® could not easily represent the full 3D model as in the FEM model, an 
approximate 2D representation of the geometry as shown in Figure 3(b) was also solved to 
understand the interaction effect of probe orientation and part geometry, including the 
crack condition. 

MODELING RESULTS 

Figure 4(a) displays the FEM results for the eddy current probe response in terms of 
dissipated power (P) and the stored energy (W). Although the trends observed in the 
response are correlated with the part geometry, given how the field generated by the small 
coil was solved using FEM with a finite irregular tetrahedral mesh, there is irregularity in 
the solution. The challenge here is that increasing the mesh density to get a smoother 
absolute response will significantly increase solution time. Figure 4(b) displays differential 
results generated by solving both the ‘no flaw’ and ‘with flaw’ conditions and taking the 
difference. Mesh error is considerably minimized when using a differential approach; 
however, simulation time (for 52 runs at 2 * 26 probe locations) is still on the order of 36 
hours. Even though some time could be saved by using an analytical model for the field 
generated by the coil in the part and working to reduce mesh size, an alternative is needed. 

Experimental results are presented in Figures 5(a) and 5(b) for the vertical response of 
the eddy current measurement for (a) no crack and (b) with crack cases. The two curves in 
each figure represent the scan in and out of the acoustic cavity. There is a characteristic 
response for the ‘no crack’ with a sharp change as the cavity is entered (on the left) and 
then a slight rise as the probe passes the thin section deeper in the cavity (to the right). 
(Note, the plot does not include the response when the probe reaches the very end of the 
cavity.) All experimental results are acquired with the orthogonal probe set. This 
corresponds with the ‘tang2’ coil orientation being on the side near the relief radius and 







crack. For more information on the experimental measurements, see references [2,4,7]. 
The crack results shown in Figure 5(b) highlight an additional characteristic Gaussian 
response as the crack region (with 0.020" remaining thickness) is scanned. Simulated 
results are provided by VIC-3D® to represent this test configuration. Instead of a complete 
orthogonal probe model, the results are only presented for the tang2 coil orientation. In 
general, the characteristic response for the part and crack condition as found in the 
experimental data are well represented in the simulated results shown in Figure 5(c). 
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FIGURE 4. Plots of (a) absolute FEM solution for eddy current response from an unflawed part and (b) 
differential FEM solution for eddy current response for a crack (with respect to unflawed specimen). 
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FIGURE 5. Plots of experimental results for vertical component for (a) no crack and (b) with crack cases, 
and (c) simulated (VIC-3D®) results for no crack and with crack (0.020" remaining thickness). 


Figures 6(a) and 6(b) present plots of the crack measurement (peak of the localized 
Gaussian) response with respect to varying remaining thickness for experimental [4] and 
simulated VIC-3D® results respectively. Note, the experimental data for the 0.020" 
remaining thickness are used to calibrate the model with the experimental data. When 
comparing the results for the 0.040" and 0.060" remaining thickness cases, the trend in the 
simulated results is found to be similar but somewhat lower than the experimental results. 
This error is likely due to the simulation using only the ‘tang2’ coil orientation and not 
representing the full orthogonal probe set. 

Figures 7(a) and 7(b) display results for the eddy current measurement for a change in 
resistance and reactance for varying probe orientation and remaining thickness. In general, 
the normal (‘norm’) probe orientation was found to have the greatest sensitivity to cracks, 
with the ‘tang2’ orientation being about half as sensitive, and the ‘tangl’ orientation far 
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FIGURE 6. Plots of crack measurement response for varying remaining wall thickness: (a) experimental 
results \ 4 ] and (b) simulated VIC-3 D® results (normalized to 0.020” value for experimental data). 
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FIGURE 7. Plots of crack response in terms of the (a) resistance and (a) reactance of an eddy current 
measurement for varying probe orientation and remaining thickness. 


lower. Prior work has shown when simply looking at the field generated by the normal and 
tangential (tang2) orientations, the tangential coil had advantages with deeper field 
penetration [7]. This is clearly true, but when considering the detection problem, the 
normal coil is more sensitive at all depths with respect to a coil orientated in a tangential 
direction. However, that does not mean that the normal coil is optimal. Not only must 
signal strength be considered for comparing different probe orientations and crack depths, 
but the noise condition for each of these probes must be completely evaluated. For 
example, the normal coil orientation has been shown experimentally to increase signal 
noise due to larger lift-off and probe wobble effects [7]. This concept to evaluate the signal 
and noise response for varying crack length is essentially the objective of model-assisted 
probably of detection evaluation and will be discussed in the next section. 

MODEL-ASSISTED POD EVALUATION IN DESIGN OPTIMIZATION 


To validate the performance of new inspection techniques, probability of detection 
(POD) studies can be performed. A model-assisted strategy for the design and execution of 


POD studies has been proposed to help mitigate the validation costs and to improve POD 
evaluation quality by addressing a wider array of inspection variables [6,5]. Using 
computer and empirical models to address variables that cannot be easily recreated in 
experimental samples is a significant opportunity. The full model assisted approach uses 
advanced computer simulations to model the inspection process and determines the POD 
for the inspection technique through a combination of experimental and simulated data. 
Recent work has demonstrated the potential of the full MAPOD methodology incorporating 
computer simulation for the inspection of cracks around fastener sites in a two layer aircraft 
structure inspection performed with an eddy current technique [5]. 

In addition to using a full model-assisted POD evaluation for validation purposes, to 
properly compare competing NDE technique designs, a MAPOD evaluation that 
incorporates an assessment of the signal and noise distributions as a function of varying 
crack length is quite necessary. To perform a model- assisted POD evaluation, all critical 
factors that impact the distributions for the noise and crack response must be evaluated. 
Concerning the noise distribution for this cases study, all variations due to the measurement 
method (use of a reference sensor or self-calibration approach), the part (for example 
variation in the location of the crack) and the probe (specifically orientation and liftoff 
from the surface) must be considered. In addition, factors that are critical for evaluating the 
response as a function of crack size include variation in the crack characteristics (in 
particular orientation) and the interaction of the probe with the unique part geometry. 

Performing a full model-assisted POD evaluation is not a trivial task; however, 
assumptions can be made in the evaluation process that can lead to a reasonable answer 
without excessive computational expense. For this case study, the interaction between the 
probe orientation and part geometry will be considered. Figure 8(a) shows a diagram of the 
three probes orientations scanned over the part geometry broken into two sides with 
Figures 8(b) and 8(c) representing the simulated results (in VIC-3D®) for the upper and 
lower sections, respectively. Although the normal coil is twice as sensitive to the cracks 
with respect to the tangential (2) coil, the normal coil was found to be an order of 
magnitude more sensitive to the part geometry. Thus, the coherent noise generated from 
the part, which also impacts sensitivity to probe wobble and liftoff, is not ideal for the 
normal coil design and indicates that the tangential (2) design is a better choice. 



probe position (mm) 

FIGURE 8. (a) Diagram of approximate model of inspection problem for three different probe orientations 
with simulated results (in VIC-3 D®) for the (b) upper and (c) lower sections respectively. 


CONCLUSIONS AND RECOMMENDATIONS 


A case study is presented for using models in eddy current NDE design for crack 
detection in Shuttle Reaction Control System thruster components. Simulations using the 
volume integral method with some model approximations were found to show good 
agreement with experimental results. Sensitivity studies were performed to explore the 
ideal probe orientations for varying crack lengths. However, it was found that to properly 
compare competing NDE technique designs, a full model-assisted POD evaluation that 
incorporates an assessment of the signal and noise distributions as a function of varying 
flaw size (crack length) is really necessary. Although performing a full model-assisted 
POD evaluation is not a trivial task, assumptions can be made in the evaluation process that 
can lead to a reasonable answer without excessive computational expense. Future work is 
proposed to perform a more complete MAPOD study, explore hybrid models to efficiently 
solve for multiscale geometries, and investigate optimum designs for improving detection 
of deep cracks. 
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Background - RCS Thruster Problem 



Observations for PROS Thruster Inspection for Model: 

• Cracks may emanate from relief radius or up flange. 
(initially model from relief radius.) 

• Cracks are intergranular but generally open. 

(initially model as open cracks.) 

• Projected crack depth (a) and ligament distance (a’) 
more critical to measure than actual crack depth. 
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Background - Thruster Problem Model 


Key Design Parameters: 

A. Part Geometry 

B. Part Material Properties 

C. Crack Parameters 

Crack length 
Desired detection range 
Crack width 

Crack orientation (angle) 


Thruster (cut-away, use simplified geometry) 

Niobium alloy (Grain noise, Roughness of cavity) 

0.000" - 0.175" (in terms of projected crack depth) 
0.020" - 0.060" (in terms of remaining material) 

open / intergranular cracks 
30° - 60° (between hole) 


Objectives for Case Study Problem: 

1. Apply Models to Optimize Inspection Design 

Probe number: single or differential probes (location) 

Probe orientation: three different axial orientations with cavity 

Frequency (multiple): 1.0 kHz - 50 kHz 

Probe (coil) dimensions: (constrained by hole diameter) 

2. Explore Model-assisted POD Evaluation for NDE Technique Validation 


Eddy Current NDE Modeling 


• Formulation 



- Maxwell’s Equations 

V x E = - jcoB 
Vxff = jcoD + J {e) 


Sample 



/m 


Anomalous 

Region 




VB = 0 

VD = p 


Magnetic Vector Potential Definition 

VxA = B 


= electric field 
= magnetic field 
= electric displacement 
= charge density 
A = magnetic vector potential 
J o = applied current density 
A = magnetic permeability 
O' = electrical conductivity 


Isotropic, Linear, Inhomogeneous Medium 

__ c) A — ► 

V 2 A = juJ 0 + jucr 1- /jV (1 / /u) x (V x A) 

dt 

Coil impedance calculation z = 


3. C.V. Dodd and W. E. Deeds, “Analytical Solutions to Eddy-Current Probe-Coil Problems,” Journal of Applied Physics, 1968 



Numerical Methods 


Methods: 

• Analytical — TREE (truncated region eignefunction expansion) 

• Finite Difference Method (FDM) 

• Finite Element Method (FEM) [OPERA-3D, COMSOL] 

• Boundary Integral Equation Method (BIEM) [ECSIM] 

• Volume Integral Method (VIM) [VIC-3D] 

• Meshless Methods 
Advantages: 

• Finite Element Method (Opera 3D) 

— Efficient discretization of awkward geometries 
— Calculations available anywhere within solution domain 

• Volume Integral Method (VIC-3D) 

— Only region of the scatterer need be discretized 
— Fast 


Thruster Problem Model 



Thruster Cut-away Simplified geometry 

for thruster model 


Model - FEM (Opera-3D) 


Thruster Simulations in Opera-3D: 

• ‘Simplified geometry’ with single coil constructed in Opera-3D 

• Modeling options: user interface, script language, or CAD file 

• Original CAD model did not mesh well (result in poor solution) 

• Converted CAD model 
into a script input file 


‘VthrusterlB.opc* - Modeller 
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Model - FEM (Opera-3D) 


Thruster Simulations in Opera-3D: 

• Script file also required for 
running parametric studies 

— crack length 

— probe location 

— probe orientation 

• Impedance from dissipated 
energy by the conductor (P) 
and stored energy (W) in domain 


Z — R j coL 







power dissipated 


Results - FEM (Opera-3D) 


Thruster Simulation Results in Opera-3D : 

Absolute FEM results 

• Irregular tetrahedral mesh produces significant variation for 
probe at varying locations 

• Trends observed in response assoc, with part geometry 

• Increasing mesh density significantly increases solution time 


no flaw - FEM simulation - tang(2) coil 




Results - FEM (Opera-3D) 


Thruster Simulation Results in Opera-3D : 

Differential FEM results 

• Mesh variation error can be simply addressed by solving for 
both ‘no flaw’ and ‘with flaw’ conditions and taking difference 

• Localized response 

• Simulation time (two conditions * 26 probe locations): ~36 hrs 
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Comparison with Experiment 


Experimental Results: 

• Orthogonal probe 


• 12 kHz 



Relief 

Radius 

◄ 




Relief 

cl 5 



Radius 
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no flaw 




with flaw (0.5 mm remaining wall thickness) 



Volume Integral Method Formulation 


• Start with Maxwell’s equations 

V x E = -joM 

V X H = -jaiD + J w 

• Restrict anomalous (flaw) regions to a layer 

(can address layers using spatial decomposition algorithms) 

• Form system of volume integral equation’s using Galerkin’s method 

• Solve system of equations to evaluate scattering (anomalous) currents 
in the flaw region (Given incident field due to excitation coil) 

• Due to the Toplitz-Hankel structure of the equations, a 3D-FFT 
conjugate gradient algorithm can be used to solve large problems. 


5. H. A. Sabbagh and L. D. Sabbagh, ‘An Eddy-Current Model for Three-Dimensional Inversion,’ IEEE Trans. Magnetics, Vol. MAG- 
22, No. 4, July 1986, pp. 282-291. 


Model - VIC-3D 


• GUI interface for def. of workspace (layers), probe and flaw region 

+ All parameters can be selected for ranging 
— Cannot import complex geometry 

• Only discretization of flaw region (open crack) required 

• Localized defect simulations can be run in seconds 

• First study: Use approximate model used to test probe orientation at 
multiple frequencies 




coil GUI: case (c) 





Simulated Response to Structure 


Noise Distribution: 

* Variation due 
to structure 

Model Trends Match Experiment: 

• 12 KHz data 

no flaw - experiment - dual coil 



no flaw - model - tangential probe (2) 



8.0 13.0 18.0 

probe position (mm) 



Response to Crack 


Crack Signal Distribution: 

9 Function of crack size 

• Compare experiment 
and simulation 


no flaw - experiment - dual coil 



with flaw (0.5 mm remaining wall thickness) 



probe - tang(2) 

^ ^ 


with flaw (0.5 mm remaining thickness) 
- model - tangential probe (2) 



probe position (mm) 



Sensitivity to Crack 


Crack Signal Distribution: 

9 Function of crack size 

• Compare experiment 
and simulation 

vary remaining wall thickness experiments 
- dual coil [61 
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Sensitivity to Crack 


Crack Signal Distribution: 

9 Function of crack size 

* Vary orientation and 
remaining thickness 
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Sensitivity Analysis - VIC-3D 


* Evaluate measurement 
sensitivity as function of 
frequency and notch length 
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Making Quantitative Comparisons 


# 


# 


Prior Work - FEM of eddy current densitv (Wincheski et al. 2007) 



normal tangential 



VIC-3D: EC measurement is due to 1) magnitude of eddy current 
density in flaw region and 2) measurement model of disturbed currents 



x (mm) x (mm) 

* To make an accurate comparison between designs, there is need to 
also include all associated variances (noise factors) in measurements 



Model-assisted POD Protocol 
(Thompson et al) 


1. 

2 . 

3. 

4. 

5. 

6 . 


Identify the scope of the POD study 
Identify factors that control signal and noise | 

O 

Evaluate quality of physics-based models 
Acquire / develop / validate simulation tools 

Acquire input parameters / parameter 
distributions 



fliwazc 3 2 


Conduct flaw signal distribution simulations and 
noise signal distribution simulations 




7. Acquire remaining information on factors empirically 

8. Acquire marginal information on independent factors 

and covariance information on dependent factors 


9. Evaluate full signal and noise distributions [ f (crack length) ] 

10. Compute POD with Probability of False Call (POFC) [Monte Carlo] 


Model-assisted POD Protocol 


Noise Distribution: 

* Variation due to measurement 
(reference, self calibration) 

* Variation due to structure 

* Variation due to probe I 

Cl 

* orientation (angular) | 

U 

• liftoff from surface 
Crack Signal Distribution: 

9 Function of crack size (mean) 

* Variation due to crack 
geometry (+ probe) 

9 initiation site 

9 crack orientation (angle) 

+ Include noise distribution 



(Thompson et al) 


Sensitivity to Structure 


Noise Distribution: Variation due to structure 
Use Approximate Model - VIC-3D simulations (12 kHz) 

• Split model into two parts 
(each half of structure) 

• Evaluate sensitivity of probe 
orientation to structure 




- 2.0 



3.0 8.0 13.0 

probe position (mm) 


18.0 


23.0 



probe position (mm) 


Summary and Future Work 


Summary: 

* Two numerical methods, FEM and VIM, were used to simulate eddy 
current NDE for cracks in a complex thruster geometry 

* Model demonstrated trends observed in experimental studies 

* Sensitivity studies performed to determine the ideal probe 
orientations and frequencies for varying crack lengths. 

* To make an accurate comparison between designs using simulation: 

— Need accurate measurement models 
— Must include all critical variances in measurements 

* MAPOD study outlined with preliminary design results 

Future Work: 

* Complete full model-assisted POD (MAPOD) evaluation 

* Explore hybrid models to efficiently solve for multiscale geometries 

* Investigate optimum designs for improving detection of deep cracks 
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